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0 Image processing device for resolution conversion. 

© An image processing device for effecting resolution conversion includes an image signal memory 1 for 
storing the input pixel levels Ixy, and an enlargement/reduction calculator circuit 2 for calculating a grey level Gxy 
of each output pixel corresponding to the average of the areas of input pixel intersecting with the output pixel. 
The error occurring upon quantization by a quantizer 4 is calculated by an error calculator 5, and, after being 
delayed by one pixel by an error memory 6, is fed back to a image signal compensator circuit 3 to be added to 
the grey level S3 to obtain the compensated gray level S4, which is quantized by the quantizer 4 to obtain the 
quantized level Oxy- 
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BACKGROUND OF THE INVENTION 

This invention relates to image processing devices for resolution conversion, utilized in image transmis- 
sion systems, storage apparatus, etc., including scanners, copying machines and facsimile machines. 

5 In image processing systems, it often becomes necessary to convert the resolution of the images. In 
the case of the facsimile machines, for example, the text and drawing images (without half-tone areas) are 
first subjected to simple bi-level thresholding. The half-tone images, on the other hand, are subjected to the 
dithering process. The resolution of the bi-level image that is obtained by these processes is designated by 
the user. Further, the information is encoded by a coding method such as MMR. When this information is 

10 transmitted to another facsimile machine, the resolution of the image must be converted such that the 
format of the information is adapted to the paper size and the resolution of the type of the machine to which 
the image is transmitted. Thus, an image scanned in an inch-based Group 4 facsimile machine should be 
subjected to an appropriate resolution conversion before being sent to a millimeter-based Group 3 machine. 
The most commonly used method for effecting the resolution conversion (or the enlargement/reduction) 

75 of the images is the nearest neighbor method (NNM). According to this method, the input and the output 
sampling points are plotted upon the image to be converted, and the signal level at the input sampling point 
nearest to the current output sampling point is selected as the output signal level. 

The nearest neighbor method (NNM) is a simple and efficient method for resolution conversion. 
However, this method has the defect that thin lines may be dropped. Thus, for obtaining better conversion 

20 image quality, various methods of resolution conversion, such as the method of taking a logical sum, the 
method of dividing into nine partitions, and the rapid projection method, are proposed. For details of such 
methods, the reference may be had, for example, to H. Morita et al., "RAPID PIXEL DENSITY CONVER- 
SION METHOD BASED ON THE PROJECTION METHOD", Proceedings of The Institute of Image and 
Electronics Engineers of Japan, Vol. 11, No. 2, pp. 72 - 83, 1982. 

25 These methods of resolution conversion, however, are primarily aimed at converting the binary image 
consisting of texts and drawings without half-tone areas. When these resolution conversion methods are 
applied to quasi-half-tone input image signal, which is obtained, for example, by means of the ordered 
dither method (ODM) or the error diffusion method, the grey scale gradation may be degraded, or moire 
patterns may be developed in the converted image. The quality of the converted image thus suffers a 

30 conspicuous degradation. 

SUMMARY OF THE INVENTION 

It is therefore an object of this invention to provide a image processing device for resolution conversion 

35 by which the gradation of the the original image is preserved and the moires are not developed such that a 
converted image of a good quality is obtained. 

The above object is accomplished in accordance with the principle of this invention by an image 
processing device for effecting resolution conversion of an image consisting of a matrix of pixels, which 
comprises: image signal memory means for temporarily storing an input image signal representing input 

40 pixel levels of an original image; grey level calculation means, coupled to the image signal memory, for 
calculating a grey level of each output pixel by calculating a weighted sum of the input pixel levels having 
an intersection with the output pixel; and quantization and compensation means, coupled to the grey level 
calculation means, including: compensation means for compensating the grey level of each output pixel for 
a quantization error, thereby obtaining a compensated gray level for each output pixel; quantization means 

45 for quantizing the compensated gray level of each output pixel, thereby obtaining a quantized level of each 
output pixel; and error calculation means for determining the quantization error from the compensated gray 
level and the quantized level. Preferably, the weighted sum calculated by the grey level calculation means 
is obtained by: multiplying the input pixel levels intersecting with the output pixel by weighting coefficients 
and then taking a sum of the input pixel levels multiplied by the weighting coefficients, wherein the 

50 weighting coefficients corresponds to respective ratios of intersecting areas of the input pixels to an area of 
the output pixel. 

It is further preferred that the compensation means adds the quantization error to the grey level of each 
output pixel, to obtain the compensated gray level; and the error calculation means includes: means for 
calculating a difference between the compensated gray level of each output pixel and the quantized level of 
55 each output pixel; and error memory means for delaying the difference by one pixel to obtain the 
quantization error added to the grey level by the compensation means. Still preferably, the error calculation 
means includes: means for calculating a difference between the compensated gray level of each output 
pixel and the quantized level of each output pixel; and error memory means for storing the differences 
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between the compensated gray levels and the quantized levels calculated for respective output pixels; and 
the compensation means includes: means for calculating a weighted sum of the differences between the 
compensated gray levels and the quantized levels of output pixels which are in a predetermined neighbor- 
hood of a current pixel; and adder means for adding the weighted sum of differences to the grey level of 

5 each output pixel to obtain the compensated gray level of each output pixel. It is further preferred that the 
device further includes: image segmentation circuit means for receiving the input image signal and for 
determining whether or not a current input pixel is in a quasi-half-tone region, wherein, upon determining 
that the current input pixel is in the quasi-half-tone region, the image segmentation circuit means 
suppresses the compensation means to compensate for the quantization error, such that the compensated 

70 gray level of each output pixel calculated by the compensation means is identical to the grey level of each 
output pixel. 

BRIEF DESCRIPTION OF THE DRAWINGS 

75 The features which are believed to be characteristic of this invention are set forth with particularity in 
the appended claims. The structure and method of operation of this invention itself, however, will be best 
understood from the following detailed description, taken in conjunction with the accompanying drawings, in 
which: 

Fig. 1 is a block diagram showing the structure of the image processing device according to the first 
20 embodiment of this invention; 

Fig. 2 is a block diagram showing the structure of the enlargement/reduction calculator circuit of Fig. 1; 

Fig. 3a is a diagram showing the relation of the pixels before and after resolution conversion; 

Fig. 3b is a diagram showing the relation of the coordinates (the column and the line indices) of pixels 

before and after resolution conversion; 
25 Fig. 4a is a table showing the correspondence of the binary components S2a through S2d of the image 

signal S2 shown in Fig. 2 and the coordinates of the input pixels (the left half of the table), and the 

values of the weighting calculations S8a through S9b (the right half of the table) for the first line of output 

image; 

Fig. 4b is a table similar to Fig. 4a, but showing the case for the second line of output image; 
30 Fig. 4c is a table similar to Fig. 4a, but showing the case for the third line of output image; 

Fig. 5 is a block diagram showing the structure of the image processing device according to the second 
embodiment of this invention; 

Fig. 6a shows the black and white checkerboard test pattern of the original image; 
Fig. 6b shows the 3/4 reduction image obtained from the original of Fig. 6a by means of the embodiment 
35 of Fig. 5 according to this invention; 

Fig. 6c shows the 3/4 reduction image obtained from the original Fig. 6a using the conventional nearest 
neighbor method (NNM); 

Fig. 6d shows the 3/4 reduction image obtained from the original Fig. 6a using the conventional 
projection method (PM); 

40 Fig. 7a is a 5/7 reduction image obtained by means of the embodiment of Fig. 5 according to this 
invention from the original bi-level image generated from a portrait (the facsimile test chart No. 1 of the 
Institute of the Image and Electronics Engineers of Japan) using the ordered dither method (ODM) at 4 x 
4; 

Fig. 7b is a view similar to that of Fig. 7a, but showing an image obtained with nearest neighbor method 
45 (NNM); 

Fig. 8 is a block diagram showing the structure of the image processing device according to the third 
embodiment of this invention; and 

Fig. 9 is a block diagram showing the structure of the image processing device according to the fourth 
embodiment of this invention, 
so In the drawings, like reference numerals represent like or corresponding parts or portions. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring now to the accompanying drawings, the preferred embodiments of this invention are 
55 described. 

First, however, before embarking upon describing the details of particular embodiments, the principle of 
this invention is described referring to Fig. 1 of the drawings. It is assumed that the original image 
consisting of a (n.mj-matrix of bi-level black and white pixels is subjected to resolution conversion to obtain 
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a (N.M)-matrix of bi-level pixels. The resolution conversion is necessitated, for example, when the image is 
enlarged or reduced in size. When, for example, the image is reduced to 75 percent or 3/4 of the original 
size, N = (3/4)n and M = (3/4)m. In Fig. 1, the input image signal S1 is a signal representing the binary 
levels Ixy of the pixel at the x'th column and y'th line of the original image, or the (x.y)-element of the (n,m)- 
5 matrix, where 1£x£ n and 1£y£m. The output image signal S5 is a signal representing the binary levels Oxy 
for the pixel at the X'th column and Y'th line of the image after conversion, or the (X,Y)-element of the 
(N,M)-matrix, where 1£X£N and 1£Y£M. In both cases, the black and the white pixels are represented by '0' 
and 'V, respectively. The exemplary relation of the input and output pixels for 75 reduction is shown in Figs. 
3a and 3b. 

10 First, input binary levels l^ (contained in the input image signal S1) of those pixels included in a 
predetermined number of lines of the (n.m)-matrix of the original image are temporarily stored in an image 
signal memory 1. Then, an enlargement/reduction calculator circuit 2 reads out from the image signal 
memory 1 the input binary pixel levels l^ (as indicated in Fig. 1 by a signal S2 supplied from the image 
signal memory 1 to the enlargement/reduction calculator circuit 2) needed for the resolution conversion of 

75 the current output pixel, and obtains an intermediate signal S3 representing the grey level Gxy of the pixels 
of the (N,M)-matrix. The grey level Gxy at the current coordinate (X,Y) of the (N.M)-matrix is calculated by 
the enlargement/reduction calculator circuit 2 as follows: 

Gxy = E (Wxy x l^) (1) 

20 

where the are weighting coefficient determined by: 

= S(PXY n Pxy)/S(PXY) (2) 

25 In equation (2), Pxy represents the pixel at (x.y) of the (n.m)-matrix of the image before conversion, Pxy 
represents the pixel at (X.Y) of the (N,M)-matrix of the image after conversion, S(Pxy n P^) represents the 
area of the intersection or overlap of the input and output pixels Pxy and Pxy, and S(Pxy) represents the area 
of the output pixel Pxy- The summation in equation (1) is taken over all the indices (x.y) of the input pixels 
Pxy which have an overlap with the current pixel Pxy- It should be noted that, throughout this specification, 

30 the lower case indices (x,y) are used to denote the coordinates of the (n,m)-matrix of the image before 
conversion, to distinguish them from the coordinates of the (N.M)-matrix of the image after the conversion, 
which are denoted by the upper case indices (X,Y). 

The the grey level Gxy is thus calculated by the enlargement/reduction calculator circuit 2 by means of 
the equations (1) and (2). Further, an image signal compensator circuit 3 calculates the signal S4 

35 representing the compensated grey level Cxy at (X,Y) of the (N.M)-matrix as follows: 

Cxy = Gxy + K a x E (3) 

where K a is a feedback parameter which may be set equal to unity (K a = 1), and E is the error signal 
40 output from an error memory 6 as described below. 

Further, a quantizer 4 quantizes the compensated grey level Cxy at the output coordinate (X,Y) by 
thresholding, for example, at 1/2, and thereby obtains the output image signal S5 representing the quantized 
binary level Oxy at (X,Y) of the (N,M)-matrix of the image after the conversion. The binary level Oxy at (X,Y) 
is determined by: 

45 

Oxy = 1 where Cxy * 1/2, and 
0 where Cxy < 1/2 (4) 

The error signal E appearing in the equation (3) is obtained by means of an error calculator 5 and error 
so memory 6. Namely, the error calculator 5 calculates the error E at coordinate (X,Y) by: 

E = Kt, x (Cxy - Oxy) (5) 

where K b is a feedback parameter which may be set equal to unity (K b = 1 ). 
55 The error E is stored in the error memory 6, and thence is fed back to the image signal compensator 
circuit 3, to be used in the calculation of the compensated grey level of the next pixel by means of equation 
(3), such that the average gradation of the original image is preserved faithfully. 
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In the case of equation (3), the error E is simply fed back to the image signal compensator circuit 3 to 
calculate the compensated grey level of the next pixel. However, according to a more sophisticated method 
described in detail below, the error E may be distributed among a plurality of pixels of the (N.M)-matrix after 
conversion. These embodiments are described in detail below, by reference to Figs. 5 and 8. 

5 Next, referring to Figs. 1 through 4, a first embodiment of this invention, which is a simple implementa- 

tion of the above described principle, is described. Fig. 1 is a block diagram showing the structure of the 
image processing device according to the first embodiment of this invention. Fig. 2 is a block diagram 
showing the structure of the enlargement/reduction calculator circuit of Fig. 1. For easier comprehension, 
the embodiment is described in a particular case where the resolution conversion is effected to reduce the 

w size of the image to three fourth (3/4) of the original. 

In Fig. 1, an image signal memory 1 temporarily stores the input image signal S1. An 
enlargement/reduction calculator circuit 2, coupled to the image signal memory 1 to receive the output S2 
thereof, effects a weighting calculation at a 8-bit precision in accordance with the magnification rate 
(enlargement/reduction factor). An image signal compensator circuit 3 receives the output S3 of the 

75 enlargement/reduction calculator circuit 2 and adds to it the quantization error of the preceding pixel output 
from a error memory 6. A quantizer 4 quantizes the output signal S4 of the image signal compensator 
circuit 3 by a fixed threshold level 1/2. Further, upon receiving the quantization output S5 from the quantizer 
4 and the output signal S4 of the image signal compensator circuit 3, an error calculator 5 calculates the 
quantization error by subtracting the former signal S5 from the latter signal S4. An eight-bit error memory 6 

20 coupled to the error calculator 5 stores the quantization error signal S6 and thereby delays it by one pixel. 

Fig. 2 shows the details of the enlargement/reduction calculator circuit 2. The signal S2 output from the 
image signal memory 1 consists of four bi-level signals S2a, S2b, S2c and S2d. The binary signals S2a, 
S2b, S2c and S2d are coupled to multipliers 2a, 2b, 2c, and 2d, respectively, which effect the multiplication 
for the enlargement/reduction in the horizontal direction. Adders 2e and 2f output the results of the 

25 weighting calculations for the upper and lower lines of the original image, respectively. Multipliers 2g and 2h 
are the multipliers for the enlargement/reduction in the vertical direction. An adder 2i receives the outputs of 
the two multipliers 2g and 2h and outputs the output signal S3 of the result of the final weighting calculation. 
A horizontal weighting coefficients generator 2j generate the horizontal weighting coefficients S8a and S8b. 
The weighting coefficient S8a is supplied to the multipliers 2a and 2b. The wdf S8b is supplied to the 

30 multipliers 2c and 2d. A vertical weighting coefficients generator 2k generate the vertical weighting 
coefficients S9a and S9b. The wdf S9a is supplied to the multiplier 2g. The wdf S9b is supplied to the 
multiplier 2h. 

Next, the operation of the first embodiment is described by reference to Figs. 3a through 4c. Fig. 3a is 
a diagram showing the relation of the pixels before and after resolution conversion. Fig. 3b is a diagram 

35 showing the relation of the coordinates (the column and the line indices) of pixels before and after resolution 
conversion. Fig. 4a is a table showing the correspondence of the binary components S2a through S2d of 
the image signal S2 shown in Fig. 2 and the coordinates of the input pixels (the left half of the table), and 
the values of the weighting calculations S8a through S9b (the right half of the table) for the first line of 
output image. Fig. 4b is a table similar to Fig. 4a, but showing the case for the second line of output image. 

40 Fig. 4c is a table similar to Fig. 4a, but showing the case for the third line of output image. The principle of 
the operation of this embodiment is as described above by reference to Fig. 1. 

As mentioned above, the magnification factor (the enlargement/reduction factor) is assumed to be 3/4, 
or 75 percent reduction. When the input image signal S1 is input, the bits thereof corresponding to the first 
line of the input image matrix is stored in the image signal memory 1 . When the bits of the input image 

45 signal S1 corresponding to the second line is received, the bits of the images S1 corresponding to the first 
and the second lines are supplied to the enlargement/reduction calculator circuit 2. At the same time, the 
bits of the images corresponding to the second line are stored in the image signal memory 1 such that they 
can be used for the processing of the next line of the input image. 

As represented by equation (2), the weighting calculations are proportional to the areas of the input 

50 pixels projected to the current pixel of the output image. Thus, the enlargement/reduction calculator circuit 2 
effects the weighting calculations with respect to the input pixel values as follows. 

Fig. 3a is a diagram showing the relation of the pixels before and after resolution conversion. Fig. 3b is 
a diagram showing the relation of the coordinates (the column and the line indices) of pixels before and 
after resolution conversion. The input and output pixels are represented by boxes defined by solid and 

55 dotted lines, respectively. Each output pixel has an overlapping area with four input pixels. For example, the 
output pixel at (1,1) (the element at the intersection of the first column and the first line) has an overlap with 
the input pixels at the input coordinates (1,1), (2,1), (1,2), and (2,2). The output pixel at (2,1) (the element at 
the intersection of the second column and the first line) has an overlap with the input pixels at coordinates 
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(2,1), (3,1), (2,2), and (3,2). The output pixel at (2,2) (the element at the intersection of the second column 
and the second line) has an overlap with the input pixels at (2,2), (3,2), (2,3), and (3,3). The other 
overlapping relationship of the input and output pixels can easily be seen from Figs. 3a and 3b. The pattern 
shown in Figs. 3a and 3b repeats itself for the rest of the image. 

5 The weighting calculations for the output pixels defined by the equation (2) above are determined 
from the overlapping relationship of the input and the output pixels shown in Figs. 3a and 3b. For example, 
for the output pixel at (1,1), the input weighting coefficients are: Wi i = 3/4 x 3/4, W 2 i = 1/4 x 3/4, W 12 = 
3/4 x 1/4, and W22 = 1/4 x 3/4. Similarly, for the output pixel at (2,1), the input weighting coefficients are: 
W21 = 2/4 x 3/4, W31 = 2/4 x 3/4, W 22 = 2/4 x 1/4, and W 32 = 2/4 x 1/4. The first factor in the above 

70 equations for the weighting coefficients Wxy corresponds to the signal S8a or S8b generated by the 
horizontal weighting coefficients generator 2j. The second factor in the above equations for the weighting 
coefficients w^y corresponds to the signal S9a or S9b generated by the vertical weighting coefficients 
generator 2k. The enlargement/reduction calculator circuit 2 determines the values of the signals generated 
by the horizontal weighting coefficients generator 2j and the vertical weighting coefficients generator 2k for 

75 the current output pixel, in accordance with the overlapping relation of the input arid the output pixels. The 
values of the signals output from the horizontal weighting coefficients generator 2j and the vertical weighting 
coefficients generator 2k are shown in the right half of the tables 4a through 4c. 

The binary levels of the input pixels having an overlap with a current output pixel are represented by 
the binary signals S2a, S2b, S2c, and S2d output from the image signal memory 1. For example, for the 

20 output pixel at (1,1), S2a = In, S2b = I21, S2a = li 2 , and S2a = l 22 . For the output pixel at (2,1), S2a = 
I21, S2b = I31, S2a = I22, and S2a = I32. The correspondence between the binary signals S2a through 
S2d and the coordinates or indices of the input pixels are shown in the left half of the tables 4a through 4c. 

Thus, the enlargement/reduction calculator circuit 2 calculates the grey level signal S3 by means of the 
following equation: 

25 

53 = S9a x (S8a x S2a + S8b x S2b) + S9b x (S8a x S2c + S8b x S2d) (6) 

which corresponds to equation (1) above. 

The values of the signals S8a, S8b, S9a and S9b generated by the horizontal weighting coefficients 

30 generator 2j and the vertical weighting coefficients generator 2k for the output pixels at (1 ,1), (2,1), and (3,1) 
are shown in the table of Fig. 4a. The values of the signals S8a, S8b, S9a and S9b generated by the 
horizontal weighting coefficients generator 2j and the vertical weighting coefficients generator 2k for the 
output pixels at (1,2), (2,2), and (3,2) are shown in the table of Fig. 4b. The values of the signals S8a, S8b, 
S9a and S9b generated by the horizontal weighting coefficients generator 2j and the vertical weighting 

35 coefficients generator 2k for the output pixels at (1,3), (2,3), and (3,3) are shown in the table of Fig. 4b. As 
described above, the relations shown in Figs. 4a through 4c repeat themselves, in modulo 4 for the 
coordinates (x,y) of the input pixels and in modulo 3 for the coordinates (X.Y) of the output pixels. 

The signal S3 representing the grey level Gxy of the output pixels is supplied to the image signal 
compensator circuit 3. The image signal compensator circuit 3 calculates the signal S4 representing the 

40 compensated grey level Cxy by means of equation (3) above, where K a = 1 and E is the error calculated by 
the error calculator 5 for the preceding output pixel by means of the equation (5), where K b = 1 . The signal 

54 is quantized by the quantizer 4 by means of the equation (4) above to produce the output image signal 
S5. 

Fig. 5 is a block diagram showing the structure of the image processing device according to the second 
45 embodiment of this invention, in which the feedback of the error is effected in a more sophisticated manner. 
The operations of elements other than the image signal compensator circuit 3A and the error memory 6, 
namely the image signal memory 1 , the enlargement/reduction calculator circuit 2, the quantizer 4, and the 
error calculator 5, are similar to the corresponding parts of the image processing device of Fig. 1. The 
signal S4 output from the image signal compensator circuit 3A represents the compensated grey level Cxy 
50 of the output pixel, and the output image signal S5 representing the binary level Oxy is calculated by the 
quantizer 4 by means of the thresholding equations (4) above. The error calculator 5 calculates the signal 
S6 representing the error Exy at (X,Y) by: 

Exy = K b x (Cxy -Oxy) (5') 

55 

where K b is a feedback parameter which is set equal to unity (K b = 1). 

The errors Exy calculated by the error calculator 5 are stored in the error memory 6 at respective 
addresses corresponding to the coordinate (X,Y). 
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The image signal compensator circuit 3A includes an adder circuit 3a and a weighting circuit 3b. The 
weighting circuit 3b stores the error weighting coefficients ay for weighting the preceding errors in the 
neighborhood of the current coordinate (X,Y) of the output pixel. For example, the relative indices (i,j) of the 
weighting coefficients ay range over the relative positions indicated by the seven blank boxes at weighting 
5 circuit 3b, relative to the box of the current coordinate (X,Y) marked by X. Then, the weighting circuit 3b 
reads out from the error memory 6 the errors E x -i, Y -j corresponding to the weighting coefficients ay, 
respectively, and calculates the weighted error Axy for the output pixel at (X,Y) by the following equation: 

Axy = E a,j x E x -,,y-j (7) 

10 

where ay are assumed to be normalized such that 
Z ay = 1 

15 The values of ay may be set as shown in the following TALBE 1, in which the positions of the 
coefficients ay corresponds to those of the boxes at the weighting circuit 3b. 

TABLE 1 



20 



1/16 


2/16 


4/16 


2/16 


1/16 


2/16 


4/16 


X 







The adder circuit 3a calculates the signal S4 representing the compensated grey level Cxy by: 

25 

Cxy = Gxy + K a x Axy (3') 

where Gxy is the grey level at (X,Y) represented by the signal S3 output from the enlargement/reduction 
calculator circuit 2. 

30 Thus, according to this embodiment, the weighted sum of the quantization errors of the seven pixels in 
the neighborhood of the current output pixel is obtained by means of equation (7) and is added to grey level 
Gxy at the current coordinate (X,Y). The average error is thus minimized in accordance with the minimizing 
average error method (MAEM), as discussed, for example, in Japanese Laid-Open Patent (Kokai) No. 64- 
19873. 

35 Fig. 6a shows the black and white checkerboard test pattern of the original image. Fig. 6b shows the 3/4 
reduction image obtained from the original of Fig. 6a by means of the embodiment of Fig. 5 according to 
this invention. It is easy to see that the macroscopic average grey level is preserved at 1/2. Fig. 6c shows 
the 3/4 reduction image obtained from the original Fig. 6a using the conventional nearest neighbor method 
(NNM). The macroscopic average grey level is changed to 5/9. Fig. 6d shows the 3/4 reduction image 

40 obtained from the original Fig. 6a using the conventional projection method (PM). The macroscopic average 
grey level is changed to 3/9. 

Fig. 7a is a 5/7 reduction image obtained by means of the embodiment of Fig. 5 according to this 
invention from the original bi-level image generated from a portrait (the facsimile test chart No. 1 of the 
Institute of the Image and Electronics Engineers of Japan) using the ordered dither method (ODM) at 4 x 4. 

45 Fig. 7b is a view similar to that of Fig. 7a, but showing an image obtained with nearest neighbor method 
(NNM). The reduction factor is 5/7 which corresponds to the reduction from the A3 to the A4 format of the 
paper size. It is apparent from Fig. 7a that the smooth gradation of is preserved according to this invention. 
However, as seen from Fig. 7b, according to the conventional nearest neighbor method (NNM), moires are 
developed and the quality of the image is conspicuously degraded. 

50 Fig. 8 is a block diagram showing the structure of the image processing device according to the third 
embodiment of this invention. The image processing device of Fig. 8 includes a compensation image signal 
memory 7 and a image signal compensator circuit 8 in stead of the image signal compensator circuit 3 and 
the error memory 6 of the image processing device of Fig. 1 . The operations of the elements other than the 
compensation image signal memory 7 and the image signal compensator circuit 8 are similar to those of 

55 Fig. 1. 

In Fig. 8, the signal S4 represents the compensated grey level Cxy, and the quantizer 4 determines the 
output image signal S5 representing the binary level Oxy at (X,Y) by thresholding at 1/2 as expressed by the 
condition (4) above. The error calculator 5 calculates the error Exy at (X,Y) by means of the equation (5'), 
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where K b = 1. 

The image signal compensator circuit 8 includes a compensation controller circuit 8a and a weight 
diffusion circuit 8b. The weight diffusion circuit 8b stores therein the weight diffusion coefficients by for the 
pixels subsequent to, and in the neighborhood of, the current coordinate (X,Y). The relative indices (i,j) 
5 range, for example, the positions indicated by the seven blank boxes at the weight diffusion circuit 8b 
relative to the box at the current coordinate marked by X. Thus, diffused errors D x+ i,y+j for the output pixels 
at (X +i,Y+j) is calculated by: 

Dx+i.y+j = by x Exy (8) 

10 

The compensation controller circuit 8a outputs the diffused errors to the compensation image signal 
memory 7. The compensation image signal memory 7 stores the diffused errors Dx-h.y+j successively at the 
respective addresses corresponding to the coordinates (X + i,Y + j). When the current output pixel is moved 
by one and thus the diffused errors thereof are received from the compensation controller circuit 8a, the 

75 compensation image signal memory 7 adds the new diffused errors Dx+i.y+j to the old content at the 
respective addresses. The accumulated error at the current coordinate (X,Y) corresponds to the weighted 
error Axy calculated by the above equation (7). Upon receiving the grey level Gxy contained in the signal S3 
from the enlargement/reduction calculator circuit 2, the compensation image signal memory 7 outputs the 
signal S4 representing the compensated grey level Cxy by means of the equation (3*), where K a = 1 . 

20 Thus, according to the embodiment of Fig. 8, the quantization error is diffused to the pixels which are 
subsequently to be processed. This error diffusion method is discussed, for example, in an article by R. 
Floyd and L. Steinberg, "AN ADAPTIVE ALGORITHM FOR SPATIAL GREY SCALE", SID 75 DIGEST, pp. 
36 - 37. 

Fig. 9 is a block diagram showing the structure of the image processing device according to the fourth 

25 embodiment of this invention. The image processing device of Fig. 9 is similar to that of Fig. 1, except that 
it includes an image segmentation circuit 9. Upon receiving the input image signal S1, the image 
segmentation circuit 9 judges whether the current pixel of the original image matrix is in the bi-level region 
without half-tone gradations (the text or the line drawing region) or the graphic or quasi-half-tone region 
resulting from the ordered dither method (ODM), etc. The image segmentation circuit 9 outputs the signal 

30 S10 indicating the result of the judgment to the enlargement/reduction calculator circuit 2 and the image 
signal compensator circuit 3. 

When the image segmentation circuit 9 judges that the current input pixel is in the bi-level region, the 
factors K a and K b in. the equations (3) and (4) are set less than unity. Preferably, the factors K a and K b are 
set equal to zero: K a = K b = 0. Thus, in the tables of Fig. 4a through 4c, the greater ones of the pair of 

35 coefficients S8a and S8b and of the pair of coefficients S9a and S9b are set equal to unity and the others 
are set to zero, and the calculation by the enlargement/reduction calculator circuit 2 by means of equation 6 
is effected accordingly. Further, the image signal compensator circuit 3 effects no compensation for the 
error E. The conversion according to the conventional nearest neighbor method (NNM) is thus effected. 
On the other hand, when the image segmentation circuit 9 judges that the current input pixel is in the 

40 quasi-half-tone region, the values of the factors are set equal to unity, such that the same resolution 
conversion as that according to the embodiment of Fig. 1 is effected. 

The image segmentation circuit 9 determines whether or not the current pixel is in the bi-level or quasi- 
half -tone region as follows: first, the number of color transition (from black to white or from white to black) 
both in the vertical and the horizontal direction within a block of 4 x 4 (or possibly 3x5) pixels around the 

45 current pixel is determined. If the total number of color transition thus determined is greater than or equal to 
a predetermined number, e.g., six (6), the pixel is judged to be in the quasi-half-tone region. Otherwise, the 
pixel is judged to be in the bi-level region. Since the black and the white dots are dispersed in the quasi- 
half-tone region, the number of color transitions tend to increase. On the other hand, in the bi-level region, 
the solid black or white area extends over a substantial area to reduce the number of color transitions. Thus, 

50 the number of color transition as defined above is a good index for separating the bi-level region from the 
quasi-half-tone region. 

The embodiment of Fig. 9 is effective in removing the shortcomings of the preceding embodiments. In 
the case of the embodiments of Fig. 1, for example, due to an attempt at preserving the half-tone gradation, 
annoying corrugated edge may be developed at the contours of a character or a line belonging to the bi- 
55 level region of the input image. According to the embodiment of Fig. 9, however, the bi-level regions are 
processed separately, and such corrugation can be effectively eliminated. 

This invention can be applied to a wide variety of image processing devices. For example, in the case 
of the above embodiments, the quantizer 4 effects bi-level quantization. However, the quantizer 4 may effect 
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multilevel quantization, at from 4 through 16 quantization levels, such that this invention is applied to the 
multilevel error diffusion method or multilevel minimizing average error method, which are used in the 
facsimile machines. Further, in the case of the above embodiments, the input image signal S1 is a binary 
signal. However, the input image signal S1 may be a multilevel signal at from 4 through 16 levels, or at 256 
5 gradation levels. Furthermore, the principle of this invention can be applied to any magnification factor other 
than 3/4. For example, this invention is applicable to the image processing devices with a reduction factor 
less than 1/2, as disclosed, for example, in Japanese Laid-Open Patent (Kokai) Nos. 64-272377 and 3- 
127502. 

70 Claims 

1. An image processing device for effecting resolution conversion of an image consisting of a matrix of 
pixels, comprising: 

image signal memory means for temporarily storing an input image signal representing input pixel 
75 levels of an original image; 

grey level calculation means, coupled to said image signal memory, for calculating a grey level of 
each output pixel by calculating a weighted sum of said input pixel levels having an intersection with 
said output pixel; and 

quantization and compensation means, coupled to said grey level calculation means, including: 
20 compensation means for compensating said grey level of each output pixel for a quantization error, 
thereby obtaining a compensated gray level for each output pixel; quantization means for quantizing 
said compensated gray level of each output pixel, thereby obtaining a quantized level of each output 
pixel; and error calculation means for determining said quantization error from said compensated gray 
level and said quantized level. 

25 

2. An image processing device as claimed in claim 1 , wherein said weighted sum calculated by said grey 
level calculation means is obtained by: multiplying said input pixel levels intersecting with said output 
pixel by weighting coefficients and then taking a sum of said input pixel levels multiplied by said 
weighting coefficients, wherein said weighting coefficients corresponds to respective ratios of intersect- 

30 ing areas of said input pixels to an area of said output pixel. 

3. An image processing device as claimed in claim 1 , wherein: 

said compensation means adds said quantization error to said grey level of each output pixel, to 
obtain said compensated gray level; 
35 and said error calculation means includes: means for calculating a difference between said 

compensated gray level of each output pixel and said quantized level of each output pixel; and error 
memory means for delaying said difference by one pixel to obtain said quantization error added to said 
grey level by said compensation means. 

40 4. An image processing device as claimed in claim 2, wherein: 

said compensation means adds said quantization error to said grey level of each output pixel, to 
obtain said compensated gray level; 

and said error calculation means includes: means for calculating a difference between said 
compensated gray level of each output pixel and said quantized level of each output pixel; and error 
45 memory means for delaying said difference by one pixel to obtain said quantization error added to said 
grey level by said compensation means. 

5. An image processing device as claimed in claim 1, wherein: 

said error calculation means includes: means for calculating a difference between said com- 
50 pensated gray level of each output pixel and said quantized level of each output pixel; and error 
memory means for storing said differences between said compensated gray levels and said quantized 
levels calculated for respective output pixels; and 

said compensation means includes: means for calculating a weighted sum of said differences 
between said compensated gray levels and said quantized levels of output pixels which are in a 
55 predetermined neighborhood of a current pixel; and adder means for adding said weighted sum of 
differences to said grey level of each output pixel to obtain said compensated gray level of each output 
pixel. 
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6. An image processing device as claimed in claim 2, wherein: 
said error calculation means includes: means for calculating a difference between said com- 
pensated gray level of each output pixel and said quantized level of each output pixel; and error 
memory means for storing said differences between said compensated gray levels and said quantized 
levels calculated for respective output pixels; and 

said compensation means includes: means for calculating a weighted sum of said differences 
between said compensated gray levels and said quantized levels of output pixels which are in a 
predetermined neighborhood of a current pixel; and adder means for adding said weighted sum of 
differences to said grey level of each output pixel to obtain said compensated gray level of each output 
pixel. 

7. An image processing device as claimed in claim 1, further comprising: 
image segmentation circuit means for receiving said input image signal and for determining 

whether or not a current input pixel is in a quasi-half-tone region, wherein, upon determining that said 
75 current input pixel is in said quasi-half-tone region, said image segmentation circuit means suppresses 
said compensation means to compensate for said quantization error, such that said compensated gray 
level of each output pixel calculated by said compensation means is identical to said grey level of each 
output pixel. 

8. An image processing device as claimed in claim 2, further comprising: 
image segmentation circuit means for receiving said input image signal and for determining 

whether or not a current input pixel is in a quasi-half-tone region, wherein, upon determining that said 
current input pixel is in said quasi-half-tone region, said image segmentation circuit means suppresses 
said compensation means to compensate for said quantization error, such that said compensated gray 
level of each output pixel calculated by said compensation means is identical to said grey level of each 
output pixel. 

9. An image processing device as claimed in claim 3, further comprising: 
image segmentation circuit means for receiving said input image signal and for determining 

30 whether or not a current input pixel is in a quasi-half-tone region, wherein, upon determining that said 
current input pixel is in said quasi-half-tone region, said image segmentation circuit means suppresses 
said compensation means to compensate for said quantization error, such that said compensated gray 
level of each output pixel calculated by said compensation means is identical to said grey level of each 
output pixel. 

35 

10. An image processing device as claimed in claim 5, further comprising: 

image segmentation circuit means for receiving said input image signal and for determining 
whether or not a current input pixel is in a quasi-half-tone region, wherein, upon determining that said 
current input pixel is in said quasi-half-tone region, said image segmentation circuit means suppresses 
40 said compensation means to compensate for said quantization error, such that said compensated gray 
level of each output pixel calculated by said compensation means is identical to said grey level of each 
output pixel. 



45 



50 



55 



5 



10 



20 



25 



10 



EP 0 561 417 A1 



FIG. I 



Ixy 

S1 



1 

L 

IMAGE 
SIGNAL 
MEMORY 



S2 



ENLARGEMENT 
/REDUCTION 
CALCURATOR 
CKT 



S3 

( 



S4 



IMAGE 
SIGNAL 
COMPENSATOR 
CKT 



QUANTIZER 



Oxy 
S5 



ERROR 
CALCULATOR 



-S6 



ERROR 
MEMORY 

- S7 



11 



EP0 561 417 A1 



r 



FIG. 2 



ENLARGEMENT/REDUCTION CaLc.CKt" 



S2a. 



S2b 



S2c 



S2d 



S8a~ 



2a 



2b 



2c 



.2d 



S8b 



HORIZOTAL 
WEIGHTS 
GENERATOR 

\ 

• 2j 



2e 



2f 



S9a, 



29 



2h 



7^ 



„.S9b 



.2i 



VERTICAL 

WEIGHTS 

GENERATOR 
. 

2k 



S3 



12 



EPO 561 417 A1 



LU 



CO 

X - 



Q 

CM 



LU 



OL 
2 



>< 
CL 

I-. 

QL 
I— 
Z> 

o 




o 



o 



o 



Q 

CO 



: co 


3,3 | 


; cm" 


T ^ 

• > 

cm j co : 

CM J CM 

• • 

: : 




j : 

CM j CO j 

' i * 

i • 

i j 



X 





CM 


co 








rf 


^r" 




CM 


CO 




CO 


CO 


CO" 


CO" 




CM 


CO 




CM- 


CM- 


CM- 


cm" 




CM 


CO 













> 



CO 

ro 

6 

Li. 



_Q 
CD 



13 



EP0 561 417 A1 
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